en
AI Ranking
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
AI Ranking
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2023-09-28 10:30:33
.
AIbase
.
1.8k
The Ma Yi Team Discovers: Fine-tuning Multimodal Large Models Leads to Catastrophic Forgetting
The Ma Yi team proposed the EMT framework to evaluate the catastrophic forgetting of fine-tuned Multimodal Large Models (MLLMs). Experiments showed that while fine-tuning MLLMs improves performance on the fine-tuning dataset, it also leads to a decline in performance on other datasets. During the fine-tuning process, MLLMs generate hallucinated text related to the fine-tuning dataset, ignoring the original problem. This research provides a framework and benchmarks for future work, but the design and training techniques of the model still need further optimization. The Ma Yi team systematically assessed the issue of catastrophic forgetting in MLLMs for the first time, balancing different capabilities.